Job Summary

As a Web Scraping focused Data Engineer, you will be responsible for extracting and ingesting data from websites using web crawling tools. In this role you will own the creation process of these tools, services, and workflows to improve crawl/ scrape analysis, reports, and data management. We will rely on you to test the data and the scrape to ensure accuracy and quality. You will own the process to identify and rectify any issues with breaks as well as scale scrapes as needed.

Qualifications

• Expertise in Python, Go, HTTP, RESTful Design or gRPC Services, HTML, and Javascript/Typescript/Angular
• Expertise with techniques and tools for extracting and processing web data (e.g. Puppeteer, Selenium, UIPath, SQL, Scraping APIs, Proxy Services, or other leading RPA solutions).
• Experience with version control, open-source practices, and code review
• Experience building applications to present content for internal review, approval, and curation
• Familiarity with data pipeline engineering, database design, web platform development, API design, or distributed systems.
• Ability to work as part of an agile collaborative team in a fast-paced environment.
• Experience collaborating with Product and Engineering teams to build a high-level roadmap and vision for a team delivering against a collaboratively defined roadmap.

Please note that this job description is meant to give a basic understanding of the position and does not cover every part of the job duties and requirements. InformData reserves the right to change or assign other duties to this position at any time.

Working Conditions

• This position requires the incumbent to work indoors at a desk for extended periods of time and use of workstation.
• The person must be able to comprehend and follow work instructions in a fast-paced, team environment.
• This position may be requested to work overtime on occasion to meet company objectives.

Physical Requirements

• Must be able to remain in a stationary position for extended periods of time
• Must be able to occasionally move about the office to access office equipment, etc.
• Must be able to constantly operate office equipment such as a keyboard, phone, computer, copier, fax machine and printer, etc.
• Must be able to frequently communicate with and listen to other InformData employees and vendors
• Must be able to occasionally move, bend, lift, push, pull and carry no more than 20 pounds
• Must be able to view multiple monitors for extended periods of time

The essential functions of the job may or may not have been described fully in this job description. Consistent with the Americans with Disabilities Act (ADA), it is the policy of InformData to provide reasonable accommodation when requested by a qualified applicant or employee with a disability, unless such accommodation would cause undue hardship.

InformData is an equal opportunity employer and provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.